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1 .     Background 

The  relationship  between  budget  requests  by  governmental   agencies  and 
subsequent  Congressional   appropriations  has  come  to  be  of  increasing  interest 
to  planners  and  students  of  the  public  sector.     Analysis  has  either  focussed 
on  the  opinions  of  participants  in  the  budgetary  process,  or  has  explored 
the  use  of  simple  linear  models  to  describe  this  relationship;   see  [8,15,4,5]. 
Quantitative  models  of  the  request-appropriations  relationship  have  in  general 
been  of  the  form 

Yt=Bxt+et  (1.1) 

where   Y.   is  the  appropriation  for  year  t  ,  x.   is  the  request  for  year 
t  ,  and  e.  is  a  stochastic  disturbance,  with 

E[et]  =  0  ,  Var[et]  =  a2  ,  Cov[£t,E:tl]  =  0  for  t  f  V    . 

It  may  reasonably  be  argued  that  (1.1)  does  not  capture  the  complex 
subtlety  of  the  budgetary  process,  nor  do  any  simple  models  answer  many  of 
the  possible  questions  about  the  relationship  of  appropriations  to  requests. 
However,  as  we  will  show,  use  of  models  akin  to  (1.1)  to  analyze  budgetary 
data  in  an  exploratory  spirit  reveals  regularities  and  trends,  and  can  help 
to  raise  questions  about  the  budget  process  through  the  identification  of 
departures  from  these  regularities  and  trends. 


2.  The  Data,  Alternative  Models,  and  Preliminary  Estimates 

This  study  is  concerned  with  an  analysis  of  two  sets  of  U.S.  Department 
of  Defense  budgetary  data. 

(1)  Procurement  data,  including  procurement  of  Army  equipment  and 
missiles  (PERMA),  procurement  of  Navy  aircraft  and  missiles  (PAMN),  procure- 
ment of  Air  Force  aircraft  (AFAC),  and  procurement  of  Air  Force  missiles  (AFM) 
for  the  years  1953-1973,  but  omitting  the  PEMA  category  for  years  1955-1958 
because  the  data  were  missing:  a  total  of  80  observations  on  budget  requests 
and  subsequent  appropriations.  The  1953-1968  data  were  taken  from  Stromberg 
[14],  who  reconciled  earlier  budget  categories  with  those  of  1968.  Later  data 
were  obtained  from  Budget  Estimates  and  Appropriations,  U.  S.  Senate,  1969-1973, 
and  also  reconciled  with  1968. 

(2)  Research  and  Development  data,  including  research,  development,  training, 
and  education  (RDTE)  requests  by  Army,  Navy,  and  Air  Force  and  subsequent 
appropriations  for  1953-1973;  there  were  a  total  of  63  observations  on  budget 
requests  and  appropriations.  Data  sources  were  the  same  as  for  the  procurement 
data. 

Previous  studies  of  budgetary  phenomena,  e.g.  by  Davis,  Dempster,  and 
Wildavsky  [5]  and  Stromberg  [14],  have  generally  employed  models  similar  to  (1.1) 
tn  order  to  describe  Congressional  appropriation  behavior  in  a  simple  manner. 
Parameters,  i.e.  3  ,  were  fitted  using  least-squares  techniques.  Our  approach 
is  comparable,  but  we  have  (i)  entertained  a  variety  of  admittedly  simple 
models,  but  somewhat  more  elaborate  than  (1.1);  (ii)  utilized  robust/ 
resistant  fitting  routines  appropriate  when  disturbances  appear  with  long, 
fat,  non-normal  tails,  cf.  Andrews  [2],  Huber  [9];  and  (iii)  studied 
residuals  from  the  fits  with  the  objective  of  uncovering  evidence  of  his- 
torically consistent  or  exceptional  behavior  otherwise  concealed  in  the  data. 


The  alternative  models  fitted  to  the  data  are  listed  in  Table  1. 
These  models  were  adopted  because  they  represent  certain  plausible  data 
behaviors  in  the  present  context.  For  instance,  it  seems  natural  that 
appropriation  size  be  related  to  request,  and  more  specifically  to  ask 
whether,  and  how,  the  percentage  of  request  granted  varied  with  request 
size.  One  may  also  ask  how  the  residuals,  as  represented  by  terms  con- 
taining fluctuations  e.  ,  seem  to  be  related  to  request  size.  Other 
questions  and  observations  are  suggested  once  preliminary  fits  are  per- 
formed. 

TABLE  1 
Models  Fitted 


Yt  ~  3xt  +  et  (2.1) 


Yt  =  6xt  +  xtet  =  (B+et)xt     (2.2) 


ut 
Yt  =  Bxte  (2.3) 


Yt  =  6xtae  t  (2.4) 


u.£nx.      a+u. 
Yt  =  3xtae  Z  =  Bxt         (2.5) 


where  Y.  represents  Congressional  appropriations  ($)  in  the  category 
under  study  in  year  t  ,  x.   is  DOD  request  in  year  t  ,  e.  and  u. 
are  uncorrelatedstochastic  disturbances  with  zero  means  and  constant 
variances. 


Parameters  in  the  models  were  estimated  (a)  by  normal -theory 
(on  e.  )-guided  maximum  likelihood  or  least  squares  (LS),  and  (b)  by 
Huber  M  technique  (HM)  of  [9  ].  The  resulting  point  estimates  appear  in 
Table  2.  See  Appendix  1  for  details  concerning  the  computational  pro- 
cedure. The  reader  is  reminded  that  HM  is  a  fitting  approach  that  dimin- 
ishes the  effect  of  aberrant  or  exotic  observations  upon  the  fitted 
parameters,  in  this  case  3  and  a  . 

TABLE  2 


Procurement 

Least  Squares 

Huber 

M 

Equation 

3 

As 

a 

3 

a 

(2.1) 

.959 

- 

.961 

- 

(2.2) 

.993 

- 

.969 

- 

(2.3) 

.977 

- 

.963 

- 

(2.4) 

1.473 

.948 

1.110 

.982 

(2.5) 

1.242 

RDTE 

.969 

.997 

.996 

3 

a 

3 

a 

(2.1) 

.982 

- 

.977 

- 

(2.2) 

1.093 

- 

.989 

- 

(2.3) 

1.025 

- 

.989 

- 

(2.4) 

2.028 

.903 

1.061 

.990 

(2.5) 

2.877 

.852 

1.029 

.994 

Equations  (2.4)  and  (2.5)  imply  that  the  percentage  of  the  request 
granted,  6xa~  ,  depends  on  the  size  of  request,  while  equations  (2.1) 
through  (2.3)  imply  that  the  percentage  is  not  related  to  the  size  of  the 


request.     In  order  to  compare  results,   the  estimated  percentages  of  the 
requests  granted  were  examined.     The  means  of  those  percentages  are  shown 
in  Table  3. 

TABLE  3 
Procurement: 


Equation 

Least  Squares 

Huber  M 

(2.4) 

.981 

.968 

(2.5) 

.975 
RDTE 

.969 

(2.4) 

1.028 

.974 

(2.5) 

1.031 

.989 

Table  3:     mean  values  for     Bx.a~       using  observed 
values  for  x.    . 

One  notes  immediately  that  for  both  data  sets  and  for  all  models 
B.  s  >  3u,v|  •     Furthermore,  the     gHM-values  for  models       (2.1    -  2.3)  differ 
much  less  than  do  the  corresponding     3.  ^-values.     Similar  comments  apply 
to  the  parameter  estimates  in       (2.4)  and       (2.5).     These  numerical  facts, 
reinforced  by  data  plotting,  suggest  that  exceptional   data  points  are  un- 
real istically  influencing  the     LS-fitted     parameters:     one  anticipates  that 
as  a  rule  requests  will   be  trimmed,  while  the  fits  of     (  2.2)  and       (2.3) 
to  RDTE  indicate  the  contrary. 


3.  Stability  of  Parameter  Estimates 

The  apparent  systematic  differences  between  the  parameter  estimates 
obtained  by  LS  and  HM  fitting  techniques  suggest  that  an  assessment  of 
statistical  stability  be  made.  Confidence  limits  at  the  nominal  95%  level 
were  constructed  in  the  following  ways. 

(a)  Under  conventional  normal -theory  assumptions. 

(b)  By  means  of  the  jackknife;  see  Miller  [12]. 

(c)  For  the  HM  estimates  by  utilizing  the  Huber  approximation,  [9], 
for  obtaining  the  approximate  variance  of  a  robust  estimator. 

(d)  By  jackknifing  the  HM-obtained  estimates.  The  latter  procedure  was 
validated  empirically  by  experimental  sampling. 

The  results  of  the  conventional  LS  analysis  are  contained  in  Table  4; 

those  for  the  robust  methods  appear  in  Table  5.  Examination  of  Table  4  reveals 

the  profound  effect  that  a  few  outlying  observations  may  have  upon  confidence 

limits  computed  under  normal  theory  assumptions:  these  limits  become  excessively 

wide--especially  is  this  true  for  the  models  (2.4)  and  (2.5).  Hence  the  robust 

methods,  that  react  less  dramatically  than  LS  to  the  appearance  of  outliers, 

were  once  again  suggested. 

TABLE  4 
95.45%  Confidence  Limits 
via  Normal  Theory 
Procurement  RDTE 

6       a  3 a 


(2.1)  (.93, .99)  (0.96,1.00) 

(2.2)  (.95,1.04)  (0.90,1.28) 

(2.3)  (.94,1.02)  (0.80,1.32) 

(2.4)  (.88,5.21)  (.79,1.11)  (2.01,3.03)      (-.75,2.15) 

(2.5)  (  0  ,  "«'')  (-1.42,3.36)  (  0  ,  "«>"  )      (-.46,2.16) 


The  conventional  measures  of  model  fit,  namely  the  (multiple  correlation)2 
or  R2  ,  are  all  high,  as  is  to  be  expected  from  examination  of  the 
graphs.  For  instance  R2  =  0.90  for  model   (2.1)  fitted  to  procurement 
data,  and  0.97  for  RDTE  ,  while  R2  =  0.91  for  model   (2.4)  fitted  to 
procurement  data,  and  0.92  for  RDTE  .  Nevertheless,  the  data  have  more 
to  suggest  than  the  adequacy  of  a  simple  model;  a  further  discussion 
appears  in  Section  4. 

The  process  of  jackknifing  revealed  observations  that  exerted  an 
extreme  effect  on  certain  LS  estimates  for  the  RDTE  data.  The  effect 
became  noticeable  from  normal  probability  plotting  of  the  pseudo-values. 
Consequently  on  a  second  iteration  the  exotic  observations  were  omitted 
from  the  LS  computations  for  RDTE  .  A  similar  examination  of  the  cor- 
responding procurement  data  pseudo-values  revealed  an  observation  that 
strongly  affected  both  LS  and  HM  estimates.  This  observation  was 
omitted  before  computing  the  confidence  limits  of  Table  4. 

Certain  aspects  of  the  results  of  this  stage  of  the  analysis  were 
notable. 

(i)  The  approximate  HM  ,  and  the  jackknifed  HM  ,  confidence 
limits  agree  closely  for  models  (2.1)  ,  (2.2)  ,  and  (2.3)  ,  and 
reasonably  well  for  (2.4)  and  (2.5)  .  All  confidence  limits  are 
somewhat  tighter  than  are  those  obtained  by  jackknifing  the  LS 
estimates. 


(ii)  The  confidence  intervals  for  3  in  models  (2.4)  and  (2.5) 
obtained  from  Huber's  approximation  are  shorter  than  are  those  from  the 
jackknifed  LS  .   In  the  RDTE  results  the  short  LS  intervals  for  (2.1), 
(2.2),  and  (2.3)  result  from  omitting  some  apparently  extreme  observations; 
these  were  not  omitted  before  computing  HM  intervals.  The  HM  procedure 
automatically  down-weights  such  observations. 

(iii)  The  estimates  of  a  for  both  models  (2.4)  and  (2.5)  are  quite 
consistent,  locating  a  at  a  value  slightly  less  than  unity.  LS  produces 
a  larger  3  and  a  smaller  a  than  does  HM  . 

(iv)  The  confidence  intervals  for  3  in  (2.4)  and  (2.5)  tend  to  be 

rather  long  as  compared  to  those  for  B  in  the  earlier  models.   However, 
the  interpretation  of  6  in  models  (2.1)-(2.3)  differs  from  that  in  models 
(2.4)  and  (2.5).  TABLE  5 

95.45%  Confidence  Limits 
Procurement 


lackkni 

fed 

LS 

Jackkni 

ifed 

HM 

Huber 

's  Approxii 

3 

nation 

3 

a 

6 

a 

a 

(2.1) 

(.93, 

,.99) 

(.92, 

,.97) 

(.94, 

.98) 

(2.2) 

(.95, 

,1.04) 

(.94, 

,.99) 

(.95, 

.99) 

(2.3) 

(.94, 

,1.01) 

(.94, 

,.97) 

(.94, 

.99) 

(2.4) 

(.32, 

,3.23) 

(.81 

,1. 

,01) 

(.81, 

,1.88) 

(.91 

,1. 

,01) 

(.90, 

1.98) 

(.91 

,1.01) 

(2.5) 

(.21, 

,3.45) 

(.80 

,1. 

.01) 

(.74, 

,1.79) 

(.91 

,1. 

13) 

(.90, 

1.95) 

(.91 

,1.01) 

RDTE 
Jackknifed  LS        Jackknifed  HM     Huber's  Approximation 


3         a         3         a         3 


(2.1)  (.95,1.01)  (.96, .99)  (.96, .99) 

(2.2)  (.98,1.04)  (.97,1.00)  (.97,1.00) 

(2.3)  (.97,1.03)  (.97,1.00)  (.97,1.00) 

(2.4)  (.94,1.50)  (.94,1.00)   (.75,1.32)  (.95,1.03)   (.91,1.24)  (.97,1.01) 

(2.5)  (.92,1.44)  (.95,1.01)   (.67,1.38)  (.94,1.04)   (.89,1.18)  (.97,1.01) 


4.  Eras  of  Congressional  Behavior:  Evidence  from  Residual  Analysis 

As  we  have  stated,  the  fitting  of  models  (2.1)-(2.5)  is  useful  in  that 
overall  trends  in  the  budgetary  activity  are  revealed.  Indeed,  the  overall  fit 
and  agreement  of  such  models  is  striking.  However,  additional  questions  arise 
which  may  be  addressed  once  the  various  fits  are  constructed.  Among  these  are 
the  following: 

(1)  Does  the  data  contain  any  evidence  of  change  in  the  general  relationship 
between  request  and  appropriation  over  the  time  period  covered? 

(2)  Did  the  services  (Army,  Navy,  Air  Force)  fare  about  equally  well  at 
the  hands  of  Congress  over  the  time  period  of  the  data? 

A  detailed  examination  of  the  residuals  (residual  =  actual  appropriation 
minus  model -projected  appropriation)  was  conducted  in  order  to  reach  tentative 
answers  to  these  questions,  and  to  suggest  others.  Since  the  robust  HM  tends 
to  follow  the  main  body  of  the  data  more  faithfully  than  does  LS,  HM  residuals 
were  the  objects  of  our  examination.  Noticeable  effects  were  the  following: 

(a)  For  both  the  procurement  and  RDTE  data,  HM  residuals  for  observations 
after  1969  were,  almost  without  exception,  negative.  This  tends  to  suggest  a 
generally  more  critical  Congressional  attitude  following  1969  --  the  latter 
date  perhaps  representing  the  end  of  an  era. 

(b)  For  the  period  before  1960  fits  of  the  procurement  data  gave  rise  to 
residuals  relatively  large  in  size,  but  with  about  as  many  positive  as  negative. 
This  suggests  that  models  are  not  working  very   well  for  this  set  of  data. 

(c)  The  residuals  associated  with  Air  Force  RDTE  were  positive,  almost 
without  exception,  for  the  period  1957-1969.  This  may  imply  that  the  Air 
Force  program  was,  comparatively  speaking,  more  appealing  to  Congress  during 
this  period. 


The  fitting  results  give  definite  evidence  of  change  in  the  relationship 
of  appropriation  to  request,  with  the  change  occurring  in  1969.  Prior  to  that 
date,  and  certainly  after  1959,  Congress  was,  "on  the  average,"  appropriating 
at  a  level  nearly  equal  to  requests:  procurement  3  was  close  to  or  slightly 
in  excess  of  unity,  while  RDTE  £  was  slightly  less  than  unity  for  the  models 
(2.1)-(2.3).  The  same  pattern  held  true  for  models  (2.4)-(2.5)  for  procurement, 
while  a-values  were  very  nearly  unity. 

For  the  procurement  data,  and  for  the  1969-1973  period,  the  value  of  3 
estimated  for  models  (2.1)-(2.3)  fell  to  about  0.9  (from  unity).  For  models 
(2.4)-(2.5)  the  estimated  8-value  rose  to  about  1.61,  but  the  a-value  fell 
to  about  0.93  (from  nearly  unity).  The  indications  are  that  during  the  later 
period  studied  larger  requests  were  cut  somewhat  more  heavily  than  were 
smaller  requests.  These  results  are  consistent  with  and  add  to  the  results 
of  recent  research  on  roll-call  voting  in  the  Senate  [11]  which  notes  a  change 
in  the  attitude  of  the  Senate  toward  defense  budget  requests  starting  with  the 
review  of  the  fiscal  1969  budget  request.  This  change  was  noted  especially 
tn  those  accounts  reviewed  by  the  Senate  Armed  Services  Committee:  procurement 
and  RDTE.  The  reason  why  the  change  occurred  at  this  time  is  not  entirely 
clear.  The  fiscal  1969  budget  was  submitted  in  January  1968  and  reviewed 
throughout  the  year.  One  hypothesis  is  that  legislators  were  either  responding 
to  or  anticipating  the  pressures  of  the  1968  elections. 

For  the  procurement  data  in  the  period  prior  to  1960,  the  confidence  inter- 
vals for  the  coefficients  are  large  in  comparison  to  confidence  intervals  for 
other  groups  of  data.  Examination  of  the  data  reveals  that  during  this  period 
Congress  was  in  many  cases  cutting  Air  Force  procurement  and  adding  to  Army  and 
Navy  procurement,  possibly  reflecting  differences  in  strategic  philosophy 

10 


between  the  Executive  and  the  Congress.  A  survey  of  literature  concerning 
this  period  reveals  the  existence  of  major  differences  in  strategic  philos- 
ophy between  the  President  and  the  Joint  Chiefs  of  Staff;  see  [10].  How- 
ever there  is  no  discussion  of  such  differences  between  the  President  and  the 
Congress.  A  further  analysis  for  the  data  in  this  period,  separating  Air 
Force  from  the  rest,  is  perhaps  indicated  but  was  not  conducted. 

For  the  RDTE  data,  and  for  the  1957-1968  time  period,  the  8-value 
estimated  was  well  above  unity,  while  that  for  other  services  was  close 
to  0.99.  Since  the  coefficients  for  Navy  and  Army  RDTE  are  nearly  unity, 
differences  between  these  services  and  the  Air  Force  are  not  due  to  the  fact 
that  the  proposed  Air  Force  program  was  more  appealing,  but  are  the  result 
of  Congressional  increases  over  and  above  the  proposed  program.  As  a  result 
of  the  differences  noted  in  the  1957-1969  time  frame  between  Air  Force  RDTE 
and  Army  and  Navy  RDTE,  Armed  Services  and  Appropriations  Committee  Reports 
were  reviewed  in  order  to  determine  a  possible  explanation  for  the  differences. 
Committee  reports  reveal  that  during  this  period  there  were  major  differences 
in  the  views  of  the  Congress  and  the  Executive  over  such  projects  as  the  B-70 
bomber  and  the  advanced  manned  orbiting  laboratory.  During  the  period  in 
question,  funds  were  added  to  Air  Force  requests  for  these  projects. 

Observations  (a)-(c)  led  to  our  re-fitting  the  models:  point  and  interval 
parameter  estimates  were  computed  for  post-1968  procurement  and  RDTE,  for  pre- 
1960  procurement,  and  for  1957-1969  Air  Force  RDTE.  These  estimates  are  ex- 
hibited in  Tables  6  and  7;  we  do  not  include  commentary  on  the  residuals  of 
the  resulting  fits;  see  [4]  for  details. 
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5.  Summary 

In  this  paper  we  have  explored  two  sets  of  data  originating  in 
defense  polttfcal  economy  by  means  of  robust  fitting  techniques  and  exam- 
ination of  the  resulting  residuals.  An  attempt  has  been  made  to  explain 
the  appearance  of  the  residuals  from  original  fits  as  the  latter  reflect 
historical  events;  a  second  round  of  fits  was  carried  out  as  a  consequence 
of  the  first.  Certainly  alternative  approaches  to  the  data  suggest  them- 
selves, as  is  likely  to  be  the  case  in  many  similar  circumstances:  for 
instance  graphical  and  numerical  analysis  of  such  re-expressed  responses 
as  (i)  appropriation  -  request,  or  (ii)  appropriation  *  request  (actually 
used  for  fitting  (2.2))  might  well  be  useful,  as  might  use  of  a  Huber 
^-function  that  more  severely  down-weights  extreme  observations  than  does 
ours.  Nevertheless  the  present  approach  appears  to  illuminate  events  of 
the  past,  and  provides  an  impetus  for  further  investigations. 
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APPENDIX  1 


The  Huber  M  Estimation  Procedure 


The  Huber  "M"  (here  HM)  robust/resistant  estimator  is  one  of  many 
that  have  been  suggested  for  parameter  estimation  when  extreme,  aberrant, 
or  exotic  observations  occasionally  occur;  see  Andrews,  et  a]_.  [1], 
Andrews  [2],  Tukey  and  Beaton  [3].  It  may  be  motivated  as  follows. 
Suppose  p(»)  is  the  density  function  of  disturbance  terms  c.  or  u. 
in  which  S  represents  scale,  and  write  down  the  log-likelihood,  e.g. 
for  model  (2.1),  which  we  shall  use  for  illustration: 


T   (  fyt-6x.l 

L(3,S)  =  I   log  pU-1 


:=1    ( 


(A  1.1) 


differentiation  yields  the  necessary  condition  for  a  minimum 


9L 


n' 

\h-**t 

P 

s 

f     11 

P 

MV 

1  s     , 

=  0 


(A  1.2) 


or,  putting     P)ffi  =  -  ip(z)   , 


Plil 


t       fyt-3x. 


=  0 


(A  1.3) 


For  the  normal  distribution  \\>(z)  =  z  ,  while  for  long-tailed  distributions, 
e.g.  the  Cauchy,  ip(z)->-0  if  |z|-*=°  .  A  compromise,  adopted  in  this  paper's 
analysis,   is  to  choose     c  >  0     (actually     c  =  1     in  our  analyses) 


*(z)  = 
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In  order  to  solve  for  3  and  for  S  it  is  necessary  to  use  an  iterative 
procedure.  That  described  by  Huber  ([9],  p.  816)  was  adopted  for  use. 
Another  approach,  based  on  iteratively  re-weighted  least  squares,  see 
Andrews  [2],  is  perhaps  somewhat  more  convenient. 
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APPENDIX     2 

Monte  Carlo  Investigation  of  Jackknifed     HM     Confidence  Intervals 

To  our  knowledge  the  properties  of  confidence  limits  constructed  by 
jackknifing     HM     regression  coefficients  have  not  been  studied,   and  so  we 
undertook  a  modest  investigation  for  our  particular  models.     The  plan  of 
the  investigation  was  as  follows. 

(a)  A  value  of     B     of  0.989,  and  of     a     of  1.000  (required  in   (2.4) 
and  (2.5))   specified  the  basic  regression  models.     The  scale  of  the  disturb- 
ance distribution,   i.e.    that  of     e.     or     u.    ,  was  chosen  to  be  the  median 

of  the  absolute  values  of  the  residuals  resulting  from  the  analysis  of 
actual   data. 

(b)  The  disturbance  distributions  were  chosen  to  be  Cauchy: 

P{e+e(dx)}  =  — •  - 

t  rr(x2+a2)       a 

where  a  is  the  scale  parameter  referred  to  in  (a). 

(c)  One  thousand  simulated  confidence  limits  were  constructed  using 
the  above  structure  for  each  model  (with  one  exception:  only  614  sample 
confidence  limits  were  constructed  for  model  (2.5)  owing  to  computational 
expense).  In  these  particular  simulations  it  was  assumed  that  the  correct 
model— the  one  giving  rise  to  the  (simulated)  data—was  known  when  confi- 
dence limits  were  computed.  We  shall  discuss  similar  results  for  the  mis- 
specification  (wrong  model)  situation  shortly.  In  the  case  of  the  jackknife 
computed  limits,  pseudo  values  were  computed  for  each  parameter  leaving  out 
one  (x. ,y.)  variable  pair  at  a  time,  and  then  the  latter  were  treated  as 
normal  and  independent  and  the  mean  and  standard  deviation  of  the  pseudo 
values  were  computed.  From  these  the  coverage  and  interval  properties  were 
found. 
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It  is  noticeable  that  the  jackknifed  intervals  obtained  by  sampling 
cover  with  quite  closely  the  nominal  coverage  (95.45%).  The  intervals 
based  on  Huber's  approximation  have  some  tendency  to  under-cover,  but  on 
the  whole  do  quite  well,  and  are  somewhat  less  expensive  to  compute  than 
are  the  jackknifed  intervals.  Not  surprisingly  in  view  of  the  above,  the 
Huber-approximation  intervals  run  somewhat  shorter  than  do  the  jackknife 
intervals. 

From  a  practical  viewpoint  one  cannot  assume  that  the  data  obtained 
"realize"  the  model  used  in  the  analysis.  In  order  to  address  this  ques- 
tion, we  have  sampled  from  one  model  (model  2.4   )  and  analyzed  the  data 
as  if  it  arose  from  our  various  alternatives. 

In  summary:  Confidence  limits  constructed  using  the  jackknife  on  the 
alternative  (incorrect)  models  cover  the  true  parameter  value  rather  ade- 
quately, while  those  obtained  using  Huber's  approximation  tend  to  under 
cover.  Further  investigations  on  this  point  are  needed.  For  other  sampling 
experiments  on  this  mis-specification  problem  reported  in  more  detail,  see 
Capra  [4]. 
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APPENDIX  3 
Procurement  Data 
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17  39. 9CC0  196 7 PAMN 

3046. COOO  L963PAMN 

3222. CCCC  1969PAMN 

3235. 5CCC  1970PAMN 

34  2  7.70  00  1971 PAMN 

406S.10CC  1972PAMN 

4118. 60C0  1973PAMN 

4233.0000  1954AFAIRCR 

2CS3.3CCC  1955AFAIRCR 

4031. COCO  1956AFAIRCR 

3859.9000  1957AFAIRCR 

4122. 9CCC  1953AFAIRCR 

4012.8000  1959AFAIRCR 

4322.8000  1960AFAIRCR 

2934. 1CCC  1961AFAIRCR 

3136.2000  1962AFAIRCR 

3135. CCCO  1963AFAIRCR 

3559. CCCC  1964AFAIRCR 

3663.0000  1965AFAIRCR 

3550. 2CCC  1966AFAIRCR 

3961.3000  1967AFAIRCR 

5532.0000  1963AFAIKCR 

4612. CCCC  1969AFAIRCR 

3775. 2GC0  1970AFAIRCR 

3314.9000  1971AFAIRCR 

3116. 5CCC  1972AFAIRCR 

3255. 70C0  1973AFAIRCR 

3012.1000  1953AFMISSI 
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APPROPRIATIONS  REQUEST 


936.9000  150S.5CCC  1954AFMISSI 

812.7000  830.20C0  1955AFMISSI 

1475. 4CC0  1449. 5C00  1956AFMISSI 

1695. 50 CO  1483. 9CCC  1957AFMISSI 

1500.7000  1578. 70C3  L953AFMISSI 

1394. 2CC0  1722. 1CC0  1959AFMISSI 

2540. 50C0  1822.  1CCC  1960AFMISSI 

-1837.6000  2124.9000  1961AFMISSI 

1928. 7CC0  1975. 2CCC  1962AFMISSI 

2459. COOO  25CC.CCC0  1963AF^ISSI 

-2141.9C00  2177.0000  1964AFMISSI 

1730. CCOO  173C.CCC0  1965AFMISSI 

796.10C0  796.1CCG  1966A«=MISSI 

1189.5000  1189.5000  1967AFMISSI 

1340. COCO  1343. CCCO  1968AFMISSI 

.-1720.2000  1768. COCO  196.9AFMISSI 

1448.1000    '  L486.4000  1970AFMISSI 

1427. 2CC0  153C.6CC0  1971AFMISS 

1683.7000     ]  1837. 43C0  1972AFMISS 

1705. OCCO    1  1816.8000  1973AFMISS 
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RDTE  DATA 


APPROPRIATIONS 

4*0*.  CCCO 

345. COCO 

345.0CC0 

333.CC0O 

410.0000 

4C0.CCC0 

498.7CC0 

1035.7003 

1041. 2CC0 

1203. 2C00 

13  19.5000 

139C. 2CC0 

1344. iOCO 

1410.6000 

1521. 9C00 

1514.2000 

1522. 6C00 

1596. 8CC0 

1618. 2CC0 

1839. 5CC0 

1829. CCCO 

70.0000 

58.6CC0 

419.9000 

439.2C00 

492. CCCO 

505. COCO 

821.2000 

1015. 9CC0 

1218. 60CO 

1301. 50CO 

1475. 9CC0 

1530.5000 

1377. 5CC0 

1444. 2CC0 

1762.4000 

1826. 5CC0 

2141. 3CCC 

2186.4000 

2165. 1CC0 

2372.3000 

2545.3000 

525. CCCO 

440.CO00 

418. 1000 

570. CCCO 

710.CO0O 

661 .OCCO 

743. CCCO 

1159.9000 

1552. 9CC0 

24C3.2CC0 

3632.  1000 

3458. 7CC0 

3117. 3CCC 

3109.4000 

3116. 8CCC 

3251  .2CC0 

3570.3000 

3060/6CCO 

2762. 1CC0 

2912.9000 

3122. 5CC0 


REQUEST 

450.CCCC 

1953 

ARDTE 

475. CCCO 

1954 

ARDTE 

355.0000 

1955 

ARDTE 

333.CCCC 

1956 

AROTE 

410. COCO 

1957 

ARDTE 

400.0000 

1958 

ARDTE 

471.C0CC 

1959 

ARDTE 

1046. 5C00 

I960 

ARDTE 

1041.7000 

1961 

ARDTE 

113C.4CC0 

1962 

ARDTE 

1329. COOO 

1963 

ARDTE 

1474. 6CC0 

1964 

ARDTE 

14C1.5CC0 

1965 

ARDTE 

1442.7000 

1966 

ARDTE 

1522. 2CCC 

1967 

ARDTE 

1544. CCCO 

1968 

ARDTE 

166  1  .9000 

1969RDTEARM 

1849. 5CCC 

1970RDTEARM 

1717. 90C0 

1971RDTEARM 

1951.5000 

1972RDTEARM 

2122. 7CC0 

1973RDTEARM 

75.7C00 

1953 

NRDTE 

74.9000 

1954 

NRDTE 

61. COCO 

1955 

NRDTE 

439.2CC0 

1956 

NRDTE 

477.00CC 

1957 

NRDTE 

505. CCCO 

1958 

NRDTE 

641.CC00 

1959 

NRDTE 

97C.9CCC 

1960 

NRDTE 

1169. CCCO 

1961 

NRDTE 

1267. COOO 

1962 

NRDTE 

1474. CCCO 

1963 

NRDTE 

1578. 4C00 

1964 

NRDTE 

1456.3000 

1965 

NRTDE 

1478.  ICCO 

1966 

NRTDE 

1752. 5C0O 

1967 

NRTDE 

1863.9000 

1968 

NRTDE 

2146.4CCC 

1969RDTENAV 

2211. 530C 

1970RDTENAV 

2157.3000 

1971RDTENAV 

2421. 4CCC 

1972RDTENAV 

2813. 8C00 

1973RDTENAV 

525.CCCC 

1953 

AFRDTE 

537.CCCC 

1954 

AFRDTE 

431. COOO 

1955 

AFRDTE 

57C.CCC0 

1956 

AFRDTE 

61C.CCC0 

1957 

AFRDTE 

661  .COOO 

1958 

AFRDTE 

719. CCCO 

19  59 

AFRDTE 

75C.CCCC 

i960 

AFRDTE 

1334.0000 

1961 

AFRDTE 

1637. COCC 

1962 

AFRDTE 

3439. COCO 

1963 

AFRDTE 

3627.9000 

1964 

AFRDTE 

221C.9CCC 

1965 

AFRDTE 

3153. 90CC 

1966 

AFRDTE 

3058.1000 

1967 

AFRDTE 

2293. 6CCC 

1968 

AFRDTE 

2364. 70C0 

1969RDTEAF 

35(1. 2CC0 

1970RDTFAF 

29CS. 7CCC 

1971RDTEAF 

3017. COCO 

1972RDTFAF 

2262. 2CCC 

1973RDTEAF 
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